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Abstract. Egge and Mansour have recently studied permutations which avoid 1243 and 2143 regarding the 
occurrence of certain additional patterns. Some of the open questions related to their work can easily be answered 
by using permutation diagrams. Like for 132-avoiding permutations the diagram approach gives insights into the 
structure of {1243, 2143}-avoiding permutations that yield simple proofs for some enumerative results concerning 
forbidden patterns in such permutations. 

1 Introduction 

Let S n be the set of all permutations of {1, . . . , n}. Given a permutation it = tt\ ■ ■ ■ n n £ S n 
and a permutation r = t\ ■ ■ ■ £ 5^, we say that n contains the pattern r if there is a sequence 
1 < i\ < i2 < ■ ■ ■ < ik < n such that the elements tt^tt^ ■ ■ ■ 7Tj fe are in the same relative order 
as T\T2 ■ ■ -Tfe. Otherwise, ir avoids the pattern r, or alternatively, tt is r-avoiding. The set of r- 
avoiding permutations in S n is denoted by S n (r). For an arbitrary finite collection T of patterns 
we write S n (T) to denote the permutations of {1, . . . , n} which avoid each pattern in T. 

Egge and Mansour || studied permutations which avoid both 1243 and 2143. This work was 
motivated by the parallels to 132-avoiding permutations. In |^, Lem. 2 and Cor. 9] was shown 
that the number of elements of 5 n (1243, 2143) is counted by the (n— l)st Schroder number r n _i. 
The (large) Schroder numbers may be defined by 

n-l 

r := 1, r n := r n _i + rjr n _i_j for n > 1. 

i=0 

For this reason the authors of [|| called the permutations which avoid 1243 and 2143 Schroder 
permutations; we will do this as well. (The reference to Schroder numbers may be somewhat 
inexact because there are ten inequivalent pairs (ti,T2) S 5| for which |<S n (ri, T2)| = r n _i, see 
0, Theo. 3]. However, it is sufficient for our purposes.) 
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Schroder permutations are known to have a lot of properties which are analogous to properties 
of 132-avoiding permutations. Why it needs to be so, a look at their diagrams shows. 
Given a permutation n € S n , we obtain its diagram D(w) as follows: first let it be represented 
by an n x n-array with a dot in each of the squares (i,TTi). Shadow all squares due south or 
due east of some dot and the dotted cell itself. The diagram D(n) is defined as the region left 
unshaded after this procedure. A square that belongs to D (tt) we call a diagram, square; a row 
(column) of the array that contains a diagram square is called a diagram row ( diagram column) . 
(The diagram is an important tool in the theory on the Schubert polynomial of a permutation. 
Schubert polynomials were extensively developed by Lascoux and Schiitzenberger. See || for a 
treatment of this work.) 

By the construction, each of the connected components of D(ir) is a Young diagram. Their 
corners are defined to be the elements of the essential set £(tt) of the permutation ir. In ||, 
Fulton introduced this set which together with a rank function was used as a tool for algebraic 
treatment of Schubert polynomials. For any element € £ (ft), its rank is defined to be the 
number of dots northwest of (i,j), and is denoted by p(i,j). Furthermore, by £ r {ft) we denote 
the set of all elements of £ (tt) whose rank equals r. 

It is clear from the construction that the number of dots in the northwest is the same for all 
diagram squares which are connected. Consequently, we can extend the rank function on the 
diagram squares. It is a fundamental property of the ranked essential set of a permutation ir, 
that it uniquely determines ir. (This result was first proved by Fulton, see j|, Lem. 3.10b]; 
alternatively, an algorithm for retrieving the permutation from its ranked essential set was 
provided in ||].) 

Answering a question of Fulton, Eriksson and Linusson gave in 0] a characterization of all ranked 
sets of squares that arise as ranked essential set of a permutation. 

To recover a permutation from its diagram is trivial: row by row, put a dot in the leftmost 
shaded square such that there is exactly one dot in each column. 

The concept should be clear from Figure 1. 



Figure 1 Diagram and ranked essential set of7r = 948 10 317625E <Sio. 
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In ||, we used permutation diagrams to give combinatorial proofs for some enumerative results 
concerning forbidden subsequences in 132-avoiding permutations. Now we develop analogues of 
these bijections. In particular, we will discuss some open problems which have been raised in 

§• 

The following section begins with a characterization of Schroder permutation diagrams. Then 
we will give a surjection that takes any Schroder permutation to a 132-avoiding permutation of 
the same inversion number. On the other hand, a simple way to generate all Schroder permu- 
tation diagrams from those corresponding to 132-avoiding permutations is described. 
Section 3 deals with additional restrictions of Schroder permutations. As it was done for 132- 
avoiding permutations we will characterize from the diagram the occurrence of increasing and 
decreasing subsequences of prescribed length, as well as of some modifications. This yields sim- 
ple combinatorial proofs for some results appearing in ||. 

In the same reference a bijection between Schroder permutations and lattice paths was given. 
Section 4 shows how the path can immediately be obtained from the diagram of the correspond- 
ing permutation. 

The paper ends with some remarks about potential generalizations of its results. 



2 A DESCRIPTION OF SCHRODER PERMUTATION DIAGRAMS 

By H Theo. 2.2], 132-avoiding permutations are precisely those permutations for which the 
diagram corresponds to a partition, or equivalently, for which the rank of every element of the 
essential set equals 0. Analogously, we can characterize the elements of <S n (1243, 2143). 

Theorem 2.1 A permutation it £ S n is a Schroder permutation if and only if every element of 
its essential set is of rank at most 1. 

Proof. If there exists an element G £(tt) (or equivalently, any diagram square (i,j)) with 
p(i,j) > 2 then, by definition, at least two dots appear in the northwest of say in the rows 
i\ < i2- Obviously, the subsequence ^i x ^%^%Hi z is of type 1243 (represented in the following 
figure) or 2143 where 7Ti 3 = j: 



*2 
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On the other hand, it is clear from the construction that the occurrence of a pattern 1243 or 
2143 in a permutation yields a diagram corner of rank at least 2. □ 

We wish to describe the diagrams more precisely that arise as diagram of a Schroder permutation. 
First we state two elementary properties of each permutation diagram. 

Lemma 2.2 Let n £ S n be an arbitrary permutation. 

a) We have i + j < n + r for each (i,j) G £ r (ir). 

b) Let be a diagram square of rank 1 for which (i — and — 1) do not belong 
to D(ir). Then n-i-i = j — 1. Furthermore, for any element (i,j) £ there exists no 
square (i',f) £ £(tt) with i' < i and j' < j. 

Proof, a) Let € ^{^) be of rank r. Then exactly r indices k < i satisfy ilk < j. By 

construction, we have 7Tj > j and i < nj 1 . Thus there exist i — r integers k < i with 7T/u > j. 
Clearly, the number of all elements nt > j in it equals n — j. This yields the restriction, 
b) By definition, there is exactly one dot (representing a pair (i' ,f) where 7Tj/ = j') northwest of 
(i, j). From the condition that forms the upper left-hand corner of a connected component 
of diagram squares follows 7Tj_i < j and ttJLi < i- Thus we have i' = i — 1 and j' = j — 1. 
For the second assertion let G <?i(vr). Suppose that there exists a diagram corner 

with i' < i and j' < j. Obviously, (i',j') must be of rank 0, and by the first part, it is different 
from (i — 1, j — 1). Thus (i',j r ) is a corner of the Young diagram formed from the diagram 
squares that are connected with (1, 1). Hence 7Tj/ +1 < j' and ttJi\i < (Note that i! + 1 < i 
and j' + 1 < j; otherwise is not a diagram square.) Consequently, there are two dots 

northwest of (i,j), contradicting to G fi(vr). □ 

Remark 2.3 Condition a) is a part of Eriksson's and Linusson's characterization of ranked 
essential sets, see [|], Theo. 4.1]. 

In case of Schroder permutations, the second claim of b) means: there are no diagram corners 
and such that i' < i and j' < j. By [||, Prop. 9.6], just this property characterizes 

vexillary permutations. Fulton's description is an important example of characterization classes 
of permutations by the shape of their essential set. He gave a set of sufficient conditions that 
all except for one are also necessary. Later, Eriksson and Linusson strengthened that condition 
to obtain a set of necessary and sufficient conditions. Note that vexillary permutations can 
alternatively be characterized as 2143-avoiding ones, see (1.27)]. Of course, every Schroder 
permutation is vexillary. 
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Consequently, we can answer the question when a subset of the n 2 squares of {1, . . . , n} 2 is the 
essential set of a Schroder permutation in S n . In particular, this yields a further combinatorial 
interpretation of Schroder numbers. 

Proposition 2.4 For s > let i% > i 2 > . . . > i s and j\ < j 2 < . . . < j a &e positive integers, 
and let r\,r 2 , ■ ■ ■ ,r s be or 1 sitc/i i/iaf 

ii - ri > i 2 - r 2 > . . . > i s - r s > and < ji - r\ < j 2 - r 2 < . . . < j s - r s . (1) 

For any n > i% + j s there is a unique permutation ir G S n with £(n) = Ji), • • • , (i s , js)} 
and p(ik,jk) = fk for k = 1, . . . ,s. In particular, tt avoids 1243 and 2143, and every Schroder 
permutation arises from a unique collection of such integers. 

Proof. See Fulton's |5|, Prop. 9.6]. The condition £ {0,1} follows from Therorem 2.1. □ 



In [||, Prop. 2.2], the condition n > i\ +j s has been replaced by ik+jk < n + r fc f° r = 1, • • • , s. 
Corollary 2.5 

a) T/ie (n — l)st Schroder number r n _i counts the number of tripels of the integer sequences 
i\ > ^2 > • • • > > and < ji < j2 < . . . < J s , and the binary sequence r±,...,r s 
satisfying (1) and ik+jk <n + rk for all k. 

b) The nth Catalan number C n counts the number of pairs of integer sequences i\ > i 2 > 
... > i s > and < j\ < j 2 < ■ ■ ■ < j s such that ik + jk < n for all k. In particular, 
the number of such pairs of sequences of length s is counted by the Narayana number 
N(n,s + 1). 

Proof. The special case of 132-avoiding permutations (p(i,j) = for each element (i,j) of the 
essential set) in yields part b). It is well known that |<S n (132)| = C n = ^fii 2 ™) f° r an n - 
The second result of b) where N(n, s + 1) = ^(") ( s ?i) appeared in |9|, Rem. 2.6c]. □ 

Some of the results of this paper are given in terms of essential sets. Therefore we will describe 
first how one can retrieve a Schroder permutation from its ranked essential set. In the special 
case of Schroder permutations the retrieval algorithm due to Eriksson and Linusson is an evident 
procedure; that's why we will do this without any technical notation used in Q. 

Let 7r G S n be a Schroder permutation, and E := £ (tt) its essential set. Hence E is a subset of 
labeled squares in {1, 2, . . . , n} 2 satisfying Proposition |2.4[ Let the elements of E be represented 
as white labeled squares in an n x n-array. (All squares that do not belong to E are shaded.) 
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Figure 2a Ranked essential setof7r = 475263l£ 5 7 (1243, 2143). 



(1) Colour white all squares (i',f) with i' < i and j' < j where (i, j) <G E is a square labeled 
with 0. In this way we obtain the connected component of all diagram squares which are of rank 
0. (Note that the rank function can be extended on the set of diagram squares.) 
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Figure 2b All diagram squares of rank are known. 

(2) Put a dot in each shaded square for which every square (i',f) with i' < i and j' < j, 
different from is a diagram square of rank 0. Obviously, these dots just represent the 

left-to-right minima of the permutation. (A left-to-right minimum of a permutation it is an 
element 7Tj which is smaller than all elements to its left, i.e., 7Tj < ttj for every j < i.) 




Figure 2c All dotted squares connected with a diagram square of rank are known. 

(3) For each dot contained in a square (i, j), colour white all squares with i < i" < i' 

and j < j" < j' where (i',f) € E is a square labeled with 1. By this step, all diagram squares of 
rank 1 are obtained. (Note that all squares which are situated in the southeast area of a given 
dot belong to the same connected component.) 




Figure 2d The diagram is completed. 

(4) Row by row, if no dot exists in the row, put such a one in the leftmost shaded square such 
that there is exactly one dot in each column. Now the permutation can read off from the array. 
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Figure 2e The permutation 7r = 4752631 is recovered. 



The following transformation explains the close connection between 132-avoiding permutations 
and Schroder permutations. 

Proposition 2.6 Let ir € S n be a Schroder permutation. Let £*{ir) be the set which we obtain 
from £{ir) by replacing every element (i,j) S £i(' IT ) by (i — 1, j — 1) and defining it to be of rank 
0. Then £*(ir) is an essential set. (In particular, £*(ir) is the essential set of a 132-avoiding 
permutation.) 

Proof. Let £ (ir) = {(h,ji), ... , (i s ,j s )}. We may assume that p(ik,jk) = 1 fo r any k, otherwise 
the assertion is trivial. Set i' k := ij. — 1, j' k := jf. — 1, r' k := r^ — 1 = 0, and check Proposition 



2.4 for E = £(tt) U {(i^j'k)} \ {(ik>3k)}- Evidently, all the conditions are satisfied (we have 
ik ~n = i' k ~r' k , j k -r k = j' k -r' k ). □ 

Example 2.7 Let vr = 4 7 5 2 6 3 1 G 5 7 (1243, 2143). Then the transformation £(tt) ^ ^*(vr) 
yields the essential setofa = 645327l€ 57(132): 



Figure 3 On the left the diagram of ir; on the right the diagram of a. 



Let (j) : S n (1243, 2143) — > 5 n be the map which takes any Schroder permutation ir to the 
permutation whose essential set equals £*{n). Obviously, <f> is a surjection to <S n (132). 
It follows from Lemma ^.2| b and the retrieval procedure that D(ir) and D((j)(ir)) have the same 
number of squares. By |^, (1.21)], for any permutation tt £ S n the number of diagram squares 
is equal to the number of inversions inv(7r) of tt. Thus we have inv(-7r) = inv(<^(7r)) for every 
7r £ 5 n (1243, 2143). Furthermore, Fulton observed in || that a permutation ir € S n has a 
descent at position % if and only if there exists a diagram corner in the ith row of the n x n-array 
representing ir. (An integer i G {1, . . . , n — 1} for which iri > ir^i is called a descent of ir G <S ra . 
The number of descents of 7r is denoted by des(-7r).) Lemma |2~2|b implies that des(7r) < des(^>(7r)) 
for each vr G 5 n (1243, 2143). 
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The left-to-right minima of a permutation tt E S n are represented by such dots for which 
or 1) are diagram squares of rank 0. To master the case 7Ti = 1 we assume that (0, 1) 
is a diagram square of rank 0. Consequently, every left-to-right minimum of n E 5 n (1243, 2143) 
is also such a one for 4>(ir). 

In H Theo. 5.1] we have shown that the number of subsequences of type 132 in an arbitrary 
permutation is equal to the sum of ranks of all diagram squares. For Schroder permutations this 
value is just the number of all diagram squares of rank 1. 

The conversion of the above transformation is a simple way to construct Schroder permutations 
which contain a prescribed number of occurrences of the pattern 132. 

Given the essential set of a 132-avoiding permutation a E 5 n (132) (recall that £(cr) is the corner 
set of a Young diagram fitting in (n — 1, n — 2, . . . , 1); all elements are of rank 0), we replace some 
elements E £ (<r) by (i + 1, j + 1) and increase their label by 1. It follows from Proposition 
2.4 and Lemma ^^ a that the resulting set is an essential set of a Schroder permutation in S n if 
and only if we have i + j < n for all replaced elements (i, j). 
For instance, from cr = 6453271 E 57(132) we obtain: 



wi = a 7T 2 = 4753261 tt 3 = 6357241 vr 4 — 6452731 tt 5 — 3756241 tv 6 — 4752631 tt 7 = 6257431 tt 8 = 2756431 

Figure 4 (All the) Schroder permutations obtained from a. 

Obviously, these are all the Schroder permutations which can be constructed in this way, that 
is, whose image with respect to (ft equals a. Note that inv(o") = 15 = inv(-7Tj) for i = 1, . . . , 8. 

Proposition 2.8 Let a E <S n (132), and let s be the number of elements E £ (a) satisfying 

i + j < n. Then there exist 2 s Schroder permutations it E S n for which </>(vr) = a. 

Proof. This follows from the preceding discussion. □ 

In g Cor. 3.7], we have enumerated the Young diagrams fitting in (n— 1, n — 2, . . . , 1) according 
to the number of their corners in the diagonal i + j = n. The number of such diagrams with 
k > corners (i, n — i) equals the ballot number b(n — 1, n — 1 — k) = 2 n-\-k C n ~n~ k ) • 
Now we are interested in the distribution of corners outside that diagonal. 

Proposition 2.9 Let c(n — l,k) be the number of Young diagrams fitting in the shape (n — 
1, n — 2, . . . , 1) with k > 1 corners satisfying i + j < n. Then we have 

n—X—h 
c(n-l,k)= ^2 



i=i 



n 



n — i 
i \ k 



n — 1 
k + i 
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Furthermore, there are 2 n 1 such diagrams with no corner outside the diagonal i + j = n. 

Proof. Consider the Young diagram as being contained in an n x n-rectangle, and consider 
the lattice path from the upper right-hand to the lower left-hand corners of the rectangle that 
travels along the boundary of the diagram. Defining the rectangle diagonal to be the x-axis with 
origin in the lower left-hand corner, we obtain a Dyck path of length 2n, that is, a lattice path 
from (0,0) to (2n, 0) which never falls below the x-axis. (In ||], we have noted that the lattice 
path resulting from the diagram of a 132-avoiding permutation it € S n in this way is just the 
Dyck path corresponding to ir according a bijection proposed by Krattenthaler in 0.) In terms 
of Dyck paths, a diagram corner satisfying i + j < n means a valley at a level greater than 
(where the x-axis marks the 0- level). The distribution of the number of these valleys was given 
in @, Sect. 6.11]. □ 

The previous both propositions immediately yield an explicit description for the Schroder num- 
bers. 

Corollary 2.10 For n > we have r n = 2 n + Y%=i 2 k c(n, k). 

Remark 2.11 Another one is r n = Y^k=o ( 2n fc~ fc )C n _fc where C n = j^( 2 ™) denotes the nth 
Catalan number. This formula follows directly from an interpretation in terms of lattice paths, 



see [11, Exc. 6.19 and 6.39]. 



3 Forbidden subsequences in Schroder permutations 

In this section we will demonstrate that diagrams can be used to obtain simple proofs for 
enumerative results concerning certain restrictions of Schroder permutations. Most of numbers 
|5 n (1243, 2143, r)| appearing below are known from their analytical derivation in Q. 

For the following investigation, only one case is really of interest: the essential set of ir £ 
<S n (1243, 2143) contains both elements of rank and 1. If £i{tt) = then it avoids 132, and all 
has been done in |]]. If there is no diagram corner of rank then we have %\ = 1, and TT2 ■ ■ ■ vr n 
can be identified with a permutation in <S n _i(132). In particular, these permutations contain as 
many subsequences of type 21 (inversions) as of type 132. (Note that the number of the first 
ones equals the number of all diagram squares, and the number of the latter counts all diagram 
squares of rank 1). 

Let us start with the consideration of increasing subsequences. In || Theo. 4.1b] we proved 
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that a permutation ir £ <S n (132) avoids the pattern 12 ■ ■ • k if and only if its diagram contains 
(n+l—k, n—k, . . . , 1). (Recall that in case of 132-avoiding permutations the diagram corresponds 
to a Young diagram fitting in the shape (n — 1, n — 2, . . . , 1).) This condition will be useful for 
Schroder permutations as well. 

Theorem 3.1 Let ir € 5 n (1243, 2143) be a Schroder permutation. Then it avoids 12 • • • k for 
any k > 1 if and only if <p(ir) avoids 12 • • • k. 

Proof. We may assume that the essential set <f(vr) contains at least one element, say (i,j), 



of rank 1; otherwise the assertion is trivial. The proof of 2.6 implies that the set £' (ir) := 
S(tt) U {(i — — 1)} \ {(i,j)} is the essential set of a Schroder permutation again. The rank of 
(i — 1, j — 1) is defined as 0. (Successive determining yields the set S*(tt) stated in Proposition 
|2.6j .) Now we consider which consequences for the corresponding permutation result from this 
transformation. 

Let a £ 5 n (1243, 2143) such that 8{a) = £'{tt). Then a differs from ir at exactly three positions. 
Let 71"^ be the element represented by the only dot in the northwest of (i,j). Furthermore let 
7Tj 2 = j. Then we have o~i = n^, ai 2 = 7Tj, Oi x = 7Tj 2 , and = ir^ for all k, different from 
i,i\,i2- The proof for this fact, we find in the retrieval procedure given in Section 2. (For a 
better understanding it is helpful to consider simultaneously the example following the proof.) 
1) The element ir^ is a left-to-right minimum of it. All the squares due north or due west 
of the dot (iijir^) are diagram squares of rank 0. Let i! be the smallest integer greater 
than i\ such that a corner of rank appears in row i! . (If such a corner does not exist, 



set i! = oo.) By Lemma 2.2b, we have i < i' . In the array representing a, the square 
(i — 1, j — 1) forms a corner of the 0-component, and the next one appears in row i! . Thus 
the dot representing o~i is contained in column -zr^. 
2) By the transformation, all squares for which i\ < i" < i and tt^ < j" < j are 

moved northwestwards. Let j' be the column index of the corner of rank which appears 
in row i\ — 1. (Note that for i\ > 1 such a one has to exist since ir^ is a left-to-right 



minimum. For i\ = 1 set j' = oo.) By Lemma 2.2b again, we have j < j'. Hence in the 
array of a the square (h,j) is dotted. 
3) Now all dots (i',cjj') with i! < i are fixed. It follows from the construction that these dots 
are just (z',7Tj/) if i' ^ i\,i- Since all diagram squares south of row i appear at the same 
position in D(a), the only possible position for the missing dot in row Z2 is (i2,^i)- For 
all other indices k we have = lit- (Note that 7r, > TTi 1 and 7Tj > 7Tj 2 .) 
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Consequently, if tt contains any increasing subsequence of length k, the permutation a contains 
such a sequence as well, and vice versa: by definition and step 2), the elements tt^ and are 
left-to-right minima of tt and a, respectively. If these elements occur in an increasing subsequence 
then as the first term. Obviously, all the elements 71^+1, . . . ,7Tj_i are greater than 7Tj 2 (= cr^). 
Furthermore we have tt^ < 7Tj 2 for k = i + . . . ,12 — 1- (Note that there exists no diagram square 
in the southeast area of (i,j).) Thus, and since tt^ < 7Tj 2 < 7Tj each increasing subsequence in 
7^7^4.1 • • • 7Tj 2 corresponds to an increasing subsequence of the same length in a^a^i ■ ■ ■ ai 2 . 
Using the arguments successively (until the permutation 4>(tt) is obtained) proves the assertion 
of the theorem. □ 

Example 3.2 For tt = 5 9 8 10 4 2 6 7 3 1 G <Si (1243, 2143) we obtain the essential set £(tt) = 
{(9, 1), (8, 3), (5, 3), (4, 4), (4, 7), (2, 8)} where (4, 7) is of rank 1. Replacing this element yields 
the essential set of a = 7 9 8 5 4 2 6 10 3 1 G «Si (1243, 2143): 



Figure 5 On the left the diagram of n; on the right the diagram of a. Only the given dots 
change their position. 

The pattern considered now is closely related to the increasing subsequences. In special case of 
132-avoiding permutations the following characterization is identical with || Theo. 4.1c]. 

Theorem 3.3 Let tt G <S n (1243, 2143) be a Schroder permutation. Then tt avoids 213- ■ ■ k if 
and only if every element (i,j) G £ (tt) satisfies i + j > n + 3 — k + p(i,j). 

Proof. Let G £(tt). The n dots representing tt are arranged as follows (the labels are the 

numbers of dots contained in the certain regions where r := p(i,j)). 



r 

■ 


i — r 
• 


j — r 








or 





■ 


• i 

n 


j 





If there is no corner (i,j') such that j < j' (see the left-hand picture) then for all elements ttj~ 
with k > i and tt^ > j we have tt^ > tTi- Clearly, tt^i < 7Tj. On the other hand, if there exists 
such a corner (i,f) (see the right-hand picture; necessarily, p(i,j) = and p(i,f) = 1) then the 
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dot northwest of (i,f) is contained in column j + 1, otherwise Lemma 2.2b fails to hold. (Note 
that this dot marks an inner corner of the 0-component.) In this case, all elements tt^ with 
k > i and irk > j satisfy ir^ > j + 1. Clearly, tt^i < j. In both cases the elements representing 
by dots in the lower right-hand region appear in increasing order since tt is 2143-avoiding. If 
i + j < n + 3 — k + p(i,j) then their number n — (i + j) + p(i,j) is at least k — 2. 
To prove the converse, suppose that every element of the essential set satisfies the above condi- 
tion. Then we have 7Ti + i>n + 3 — k for all i £ D(7r). Hence for each descent i of tt there exist 
at most k — 3 elements 7Tj with j > i and ttj > 7Tj. Since tt is 2143-avoiding these elements form 
an increasing sequence. Thus there is no pattern 2134 • • • k in tt. □ 

Now we are in the position to answer the first of a collection of open problems given in 
||. Theorem 6.5 of this reference implies the Wilf-equivalence of {1243, 2143, 12 ••• k} and 
{1243,2143,213- ■■ k}, that is, |«S n (1243, 2143, 12 • • ■ k) \ = |«S n (1243, 2143, 213 • • • k)\ for all n and 
k. The authors asked for a combinatorial proof of this fact. There is a simple bijection in terms of 
diagrams whose essence was already used to prove the analogue for 132-avoiding permutations. 

Corollary 3.4 There is a bijection co : <S n (1243, 2143) -> 5 n (1243, 2143) such that for all k > 1 
and any permutation tt £ 5 ri ,(1243, 2143), we have that tt avoids 12 • • • k if and only if lu(tt) 
avoids 213 • • • k. 

Proof. Let tt £ 5 n (1243, 2143) be a Schroder permutation which avoids 12 • • • k. By Theorem 



3.1 and ||, Theo. 4.1b], the diagram of € 5„(132) contains (n + 1 — k, n — k, . . . , 1). Since 
all the corners of (n + 1 — k, n — k, . . . , 1) are in the diagonal i + j = n + 2 — k we have i + j > 
n + 2 — k + 2p(i, j) for all £ £ (tt). Hence the diagram corners of rank 1 satisfy the condition 
of Theorem |3.3| anyway. Thus every diagram corresponding to a 12 • • • /c-avoiding Schroder 
permutation is uniquely determined by its corners outside the shape (n + 1 — k, n — k, . . . , 1), 
that is, by all corners except for those satisfying i + j = n + 2 — k. Consequently, the diagram 
of lu(tt) we define to be this one whose corners are the corners of D(tt) which are not contained 
in (n + 1 — k, n — k, . . . , 1). Ranks are kept up. 

Conversely, given any Schroder permutation a € <S ra (1243, 2143) whose all diagram corners satisfy 
i+j > n + 3 — k + p(i,j) we construct the permutation uj^ 1 (a) as follows: let E be the corner 
set of the diagram obtained as union of D(4>(a)) and (n + 1 — k, n — k, . . . , 1). (Note that this is 
a Young diagram since D((J)(tt)) is such a one.) Then we form the essential set of to~ 1 (a) from 
the pairs £ E for which (i + l,j + 1) ^ £i(&), and all elements of £\(a). The first ones 
are defined to be of rank 0, the rank of the latter should be 1. Obviously, the resulting set is an 
essential set of a 12 • • • A;-avoiding Schroder permutation. □ 
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Example 3.5 The maximum length of an increasing subsequence in the Schroder permutation 
7r = 4631572e S 7 (1243, 2143) equals 3. Taking k = 4, we obtain w(vr) = 163457 2: 

































1 






1 







Figure 6 Construction of u>(n): the corners crossed out satisfy i+j — n + 2 — k. 
Remarks 3.6 

a) Since £i(tt) = £\{uj{tt)) for all tt G 5(1243,2143, 12 • • • k) the map uj takes any 132-avoi- 
ding permutation to a permutation which avoids 132 as well. Indeed, the restriction of 
uj on 5(132, 12 • • • k) is precisely the bijection given in Cor. 4.4] that proves the Wilf- 
equivalence of {132, 12 • • • k} and {132, 213 •• • k}. 

b) It is clear from the construction that a 12 • • • fc-avoiding Schroder permutation also avoids 
213 ■ ■ ■ k if and only if it is a fixed point of uj. The essential set of such a permutation 
can be constructed as follows: consider the corner set of a Young diagram which contains 
(n + 1 — k, n — k, . . . , 1), and fits in (n — 1, n — 2, . . . , 1). Now replace at least all elements 
(i, j) by {i + 1, j + 1) for which i + j = n + 2 — k. Some further corners can be replaced if 
these satisfy i + j < n. The rank of all new corners is set as 1; let the others be of rank 0. 
We will discuss the enumerative consequence only for k = 3. 

Corollary 3.7 |«S„(1243, 2143, 123, 213)| = 2 n - 1 for all n> 1. 

Proof. Taking up again the idea of the previous remark, the diagram of a Schroder permutation 
tt G 5 n (1243, 2143) which avoids both 123 as 213 arises from a Young diagram that contains 
(n — 2, n — 3, . . . , 1), and fits in (n— 1, n — 2, . . . , 1). Clearly, each such Young diagram is uniquely 
determined by its corners in the diagonal i + j = n. In particular, there are 2 n_1 diagrams of 
this kind. (This implies |5 n (132, 123)| = 2 n_1 ; see [|ll], Prop. 7] for another proof.) 
From the corner set of each Young diagram the essential set of only one permutation tt E 
<S n (1243, 2143, 123, 213) can be generated because all the corners (i, n — 1 — i) must be replaced, 
but all the corners (i, n — i) must not be replaced. □ 

Remark 3.8 To obtain a {132, 123, 213}-avoiding permutation in the way described in the 
proof, the Young diagram must not have any corner in the diagonal i + j = n — 1. We can 
identify such a diagram by a binary sequence of length n — 1 whose ith element is defined as 1 
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(or 0) if (i,n — i) is a corner (or not). The condition that there is no diagram corner outside 
the diagonal i + j = n means that the corresponding sequence contains no consecutive zeros. 
The number of such sequences is known to be equal the (n + l)st Fibonacci number F n+ \. (The 
Fibonacci numbers are defined by F\ = F2 = 1 and F n = F n -i + F n -2 for n > 3.) The result 



|<S n (132, 123,213)[ = F n+ i already appears in [1C, Prop. 15] 



The next result deals with the occurrence of a decreasing subsequence of length k in Schroder 
permutations. The analogue for 132-avoiding permutations is simple: a permutation tt G <S n (132) 
avoids k(k — 1) • • • 1 if and only if \£ (tt)\ < k — 2, see (9], Theo. 4.1a]. Now the condition is some 
more difficult. 

To state it, we first set some notation. For a permutation tt E S n we denote by r(ir) and c(ir) 
the number of rows and columns, respectively, that contain a diagram corner. As mentioned 
above, we have r(jr) = des(-7r), and c(n) = des(7r _1 ). (Note that the transpose of D(tt) is just 
the diagram of vr _1 .) It follows from Proposition |2.4| that any diagram row (column) contains 
at most two corners (necessarily of different rank) if ir € 5 n (1243, 2143). Let ^(71") and 02(71") be 
the number of diagram rows and diagram columns, respectively, containing two corners. 

Theorem 3.9 Let ir E 5 n (1243, 2143) be a Schroder permutation. Then tt avoids k(k — 1) • • • 1 
if and only if one of the following conditions holds: 

(i) r{ir) < k - 2 or c(vr) < k - 2; 

(ii) r(iv) = k — 1, r2(vr) = C2(vr) = 1, and there is no element € £(tt) that such both row 
i and column j contain another corner. 

Proof. Suppose that it contains a decreasing subsequence of length k. Obviously, its inverse 
contains such a sequence as well. Consequently, both tt and 7r _1 must have at least k — 1 
descents, that is, r(ir) > k — 1 and c(tt) > k — 1. Now let r(ir) = k — 1 and ^(tt) = 02(71") = 1. 
(Then we also have c(ir) = k — 1.) 

If the essential corners are arrange as in the picture opposite (where 12 7^ £3) we 
have 71"^ > 7Tj 1+ i, 7Tj 2 > 7Tj 2+ i (corners correspond to descents) but 7^ < 7Tj 2 , 
and 7Tj 1+ i < 7Tj 2 +i. The last relation follows from the fact that (i2,^i 2 + 1) is 
a diagram square by the construction. If its rank would be equal to then 
r2 > 1. Since des(7r) = k — 1 there is no decreasing subsequence of length k in tt which contradicts 
the assumption. In the second case (corners (i\, j'2), («2,ji) of rank 0, corners (*i , J3) , (13, ji) of 
rank 1 where i\ < *2 < h and ji < j'2 < J3) use the same arguments. 

On the other hand, if condition (i) holds then des(7r) < k — 2 or des(7r _1 ) < k — 2 and hence 
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7r € S n {k • • • 1). If (ii) is satisfied then (as shown in the first part of the proof) ir cannot contain 
any decreasing subsequence of length k. □ 

Here we will enumerate the permutations described in Theorem only for k = 3. To satisfy 
condition (ii) is impossible in this case. Thus a Schroder permutation is 321-avoiding if and only if 
all its diagram corners are either in the same row or in the same column. This characterization 
was already given in [Q, Prop. 5.4] for 321-avoiding vexillary permutations. (Note that the 
essential set of a vexillary permutation can contain elements of rank greater than 1; for example, 
1243 is such a permutation.) 

Egge and Mansour have shown (derived from the generating function in ||, Prop. 7.4]) that 

|5 n (1243, 2143, 321) | = *) + ("^ *) + 2 (" 2 ^ + 2 (" 3 ^ for a11 n ^ L 
Their fourth problem asked for a combinatorial proof. Here it is. 

Corollary 3.10 |«S„(1243, 2143, 321) | =n + 2(") for all n > 1. 

Proof. Let ir be a Schroder permutation avoiding 321. We distinguish the three cases mentioned 
at the begin of the section. 

If 7T € 5 n (132), different from the identity, then its diagram is a rectangle whose lower right-hand 
corner (i,j) satisfies i + j < n. There are 

n-i 



[n 

i=i 



such diagrams. (The enumeration of {132, 321}-avoiding permutations was first done in ||To| , 
Prop. 11].) If there exists no element of rank in £(ir), the permutation iT2 — 1 • • • ir n — 1 
belongs to 5 n _i(132, 321). 

It remains to consider the case that D(ir) has corners of rank and 1. Since these squares are 
in the same row or column there is exactly one corner of each rank. Without loss of generality, 
we may assume that the both elements of £(ir) are in the same row. (For the result in terms 
of columns consider the transpose that corresponds to the inverse of ir.) Let (i,j) € £q{it) and 



(i,f) 6 £\{k). From Proposition 2.4 the conditions 1 < i, j + 1 < j', and i + j' < n + 1 results. 
Given the pair (i, j), the integer j 1 can be chosen in n — i — j ways where i 6 {2, . . . , n — 2}, and 
j 6 {1, . . . , n — 1 — i}. Clearly, 



n-2 n-l-i ., n— 3 



1— x— i 1 fi—O / -. \ 



i=2 j=l 8=1 
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Summarized, we obtain |5 n (1243, 2143, 321) | = 1 + (£) + ( n ~ X ) + 2( n ~ 1 ) • (Note that the term 1 
stands for the identity; the factor 2 regards rows and columns in the third case.) □ 

The last pattern we will discuss is a special case of an important class as well. In H Theo. 
4.5], we characterized 132-avoiding permutations which avoid the additional pattern s(s + 
1) • • • A;12 • • • (s — 1) where s € {2, . . . , k}, and k > 3. The condition given there was of technical 
nature but for s = 2 and k = 3 it is equivalent to the following simple one: a permutation 
7r € <S n (132) avoids 231 if and only if all its diagram rows are of distinct length, that means, all 
diagram rows contain a corner. Analogously to that, 231-avoiding Schroder permutations can 
be described. 

Proposition 3.11 A Schroder permutation tt € <S n (1243, 2143) avoids 231 if and only if 

(i) every diagram row contains a (namely, exactly one) element of the essential set, 

(ii) and every diagram column contains at most an element of the essential set. 

Proof. Suppose that it £ <S n (1243, 2143) contains a 231-pattern: let i\ < i<i < is such that 
fti-i < TTii < 7Ti 2 - Since diagram corners and permutation descents corresponds to each other, 
there is an integer i with i\ < i < ii such that row i contains no corner. We assume that this 
row does not belong to the diagram, otherwise condition (i) fails to hold. Since (12,^3) £ D(tt) 
we have 7Tj = 1, and all diagram squares appearing below the ith row are of rank 1. By the 
construction, (i + 1,2) is the upper left-hand corner of the component which contains (i2,^i 3 ) 



(and all the other diagram squares of rank 1). By Lemma 2^0 there is no corner in the strict 
northwest of another one. Therefore, and since tt^ < 7Tj 2 , the diagram corners containing in row 
i — 1 and i + 1, respectively, have to be in the same column. 

For the other direction, we suppose that there are a diagram square for which + 1) ^ 

D(ir), and a square (i2,j) £ ( ^'( 7r ) with i\ < %i- (Then one of the conditions (i) and (ii) is not 
satisfied.) It is easy to see that where 7Tj 3 = j is a subsequence of type 231. □ 

From the first part of the proof, it is clear how the diagram of a 231-avoiding Schroder permu- 
tation has to look. 

Corollary 3.12 The diagram of a Schroder permutation satisfies the conditions of Proposition 



3.11 if and only if it is of the following shape: 



E 


J 

j' 


'U 3 
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where the diagram components Eq and E\ are Young diagrams whose row lengths are each 
distinct. (It may be that Eq and/or E\ are empty.) 



As an immediate consequence we can characterize 231-avoiding Schroder permutations from 
their descent set. 

Corollary 3.13 Let ir € S n be a permutation, and D(-7r) the set of its descents. Then ir avoids 
the patterns 1243, 2143, and 231 if and only if one of the following conditions is satisfied: 

(i) s > d and D(ir) = {1,2,..., d}; 

(ii) s < d and D(ir) = {1, 2, . . . , s — 1, s + 1, s + 2, . . . , d + 1}, and tt s -\ > n s +i if 1 < s < n 
where ir s = 1 and d = des(7r). 

Remark 3.14 We can decide by the conditions whether a 231-avoiding Schroder permutation 
avoids the pattern 132 in addition or not. The first condition describes all permutations in 
<S n (132,231). 



Corollary |3.12 yields the answer to the third question of the Egge-Mansour list. 



Corollary 3.15 For n > 2 we have \S n (1243, 2143, 231) | = (n + 2)2 n " 3 . 

Proof. Let ir € 5 n (1243, 2143, 231). Consider the partition X(tt) whose parts are just the lengths 
of the diagram rows where the length of the first row containing squares of rank 1 is listed 
twice. (By this information D(tt) and hence tt is completely described.) Adding some zeros (if 
necessary), we may assume that A = (Ai, . . . , A n _i) is of length n— 1. By the previous discussion, 
we have 

n > Ai > A 2 > • • . > Aj_i > \ > A i+ i > . . . > A; > A m = A z+2 = . . . = A n _i = 

with / € {0, . . . , n — 1}, and AC (n — 1, n — 1, n — 2, . . . , 2) (where C means the containment of 
the corresponding diagrams). Furthermore we have Aj ^ 1 for all j if any positive part exists 
twice. 

To set A such that all the positive parts of A are distinct, there are Y^i=® ("T 1 ) = 2 n_1 ways. 
(This case corresponds to 132-avoiding permutations; hence |5 n (132, 231) | = 2 n_1 , see also [10, 
Prop. 9].) If there exists a positive part twice then the number of partitions be considered 
equals 

£ 2 ("; 2 )G)- ( "- 2 »£("7 3 )^"- 2)2 "- 3 

1=1 v / v / /=o v 7 
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Note that 1 must not a part of A now. Consequently, there are 2 n " 1 + (n - 2)2 n " 3 = (n + 2)2 n ^ 3 
Schroder permutations in S n which avoid 231. n 



4 A CORRESPONDENCE TO LATTICE PATHS 

It is well known that the nth Schroder number r n counts the number of all lattice paths from the 
origin to (n, n), with steps [1,0] (called East steps), [0, 1] (called North steps), and [1, 1] (called 
Diagonal steps), that never pass below the line y = x. Such paths we call Schroder paths. (See 



11, Exc. 6.39] for further combinatorial interpretations of the Schroder numbers. 



Egge and Mansour have given a bijection ^ em between these paths and Schroder permutations 
in 5 n+ i, see || Sect. 4]. Its essential property is: the number of subsequences 12 • • • k occuring 
in 7r € <S n +i(1243, 2143) can read off (more or less) directly from the path ^ em{^)- 
This bijection can be unterstood as analogue of Krattenthaler's correspondence ^> k between 
132-avoiding permutations in S n and lattice paths from (0, 0) to (n, n) without diagonal steps, 
never passing below the line y = x. The map ^> k encodes the number of increasing subsequences 
of prescribed length in the same way, see || (3.2)]. 

We pointed out in || that the path and the diagram of a 132-avoiding permutation -k 

are closely related to each other. Considering the diagram of ir € <S n (132) as being contained in 
an n x n-rectangle, ^k(^) is the lattice path which goes from the upper right-hand to the lower 
left-hand corners of the rectangle, and travels along the diagram boundary. 
For 7r = 645327lG 57(132), for example, ^k{^) equals the lattice path printed in bold: 



Figure 7 Lattice path ^ K (6453271). 

We can construct the path ^em just as simple from the permutation diagram. 
Note again that each (Schroder) permutation is uniquely determined by its ranked essential 
set. Consequently, position and rank of the diagram corners are all that we have to transfer 
to a path corresponding to the permutation. Since a permutation it £ 5 n +i (1243, 2143) should 
correspond to a Schroder path from (0,0) to (n,n), we cannot use D(tt) itself but the diagram 
of 4>(ir) is fitting. Recall that the diagram of ^(tt) is obtained from that one of n by "moving" 
each diagram square of rank 1 northwestwards. Hence it is a Young diagram which is contained 
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in {n — 1, n — 2, . . . , 1). Labeling all corners with their original rank we have all information 
needed to recover tt. 

Now the Schroder path corresponding to tt is constructed as follows: let D(4>(tt)) be embeded 
in an (n — 1) X (n — l)-rectangle. Analogously to the construction of ^k, the lattice path is 
defined to go from the upper right-hand to the lower left-hand corners of the rectangle, along 
the diagram boundary, where every step sequence NE representing a corner labeled with is 
replaced by a step D. Last we convert the path into the form used in |J. To this end, the 
rectangle is reflected such that the origin is placed at the bottom left instead at the top right. 

Example 4.1 Let tt = 4752631 G <S 7 (1243, 2143). Using the diagram of 4>(tt) we can 
immediately determine the Schroder path corresponding to tt (printed in bold again): 

(0,0) (6,6) 
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(6,6) 



(0,0) 



Figure 8 Construction of the path ^eai(tt): On the left the diagram of n; in the centre the 
diagram of 4>(tt) with plotted path; on the right the converted path. 

By Lemma |2.2| a, each element £ £i(vr) satisfies i + j < n + 1. Thus, for every corner 

of D{4>{tt)) labeled with 1 we have i! + f < n — 1. Therefore, and since D(<P(tt)) is contained in 

(n — 1, n — 2, . . . , 1), this construction indeed yields a Schroder path. 

It is not difficult to see that the path obtained in this way is just \& em{k) for tt E 5 n (1243, 2143) 
but the construction via diagram requires less effort. 

In Q, the path statistic corresponding to the number of subsequences of type VI- --k in 
tt € 5 n (1243, 2143) is defined for k > 2 by 

h(s) 



E 



k-l 



se{E,D} 

where h(s) denotes the height of the starting point of step s. (The height of a point (x, y) in the 
plane we define to be the difference y — x.) 

Example 4.2 Consider the Schroder path NENNEDENED appearing in the previous example. 
For each east and diagonal step the height is given in the picture. 



Figure 9 Schroder path with step heights. 
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Thus there occur six subsequences of type 12 (noninversions), one of type 123, and no one of 
type 12 • • • k for k > 4 in the corresponding permutation 7r = 4752631 € 57(1243, 2143) 

Remarks 4.3 

a) In particular, a permutation n € <S n (1243, 2143) avoids 12 • • • k if and only if the path 



^em(^) has no step of height at least k — 1. This result is equivalent to Theorem 134 



b) Combining ^em ■ 5 n (1243, 2143) — > S n -i with the bijection u stated in Corollary |3T4 



yields the answer to the first part of the first problem raised in [Q. (By <!?„.- 1 the set of 
Schroder paths from (0,0) to (n — 1, n— 1) is denoted.) The map u o ^f^ M : 5 n _i — > 
5 n (1243, 2143) takes every Schroder path whose maximum step height is at most k — 2 to 
a 213 • • • A:-avoiding Schroder permutation, and is bijective, of course, 
c) Obviously, the path $em(7t) contains no diagonal step if and only if £q(tt) = 0. As 
already noted, then m = 1 and n' := (tt2 — 1)(tt3 — 1) • • • (ir n — 1) belongs to <S n _i(132). 
In particular, we have ^em(^) = ^k(^') in this case. 



5 Perspectives 

As already observed by Egge and Mansour in ||, the investigation of 132-avoiding permutations 
and {1243, 2143}-avoiding ones, respectively, can be continued in a canonical way. For m > 3 
let T m be the set of permutations in S m for which 7r m _i = m and 7r m = m — 1. For example, 
T3 = {132} and T4 = {1243, 2143}. (The integer sequences counting the permutations in S n (T m ) 
were determined in []l]].) Some of what we have done for 132-avoiding permutations in |j, and 
for T4-avoiding permutations in this paper can be generalized for an arbitrary integer m. 

Theorem 5.1 A permutation tt E S n avoids each pattern in T m if and only if every element of 
its essential set is of rank at most m — 3. 

Proof. If there exists an element (i,j) G ^X 71 ") with p(i,j) > m — 2 then at least m — 2 dots 
appear northwest of (i, j). Consequently, there are integers i\ < 12 < ■ ■ ■ < i m -2 < i for which 
7Ti i: . . . ,TTi m _ 2 < j. Furthermore, we have i < i m -\ and tti > j where vrj m _ 1 = j. Thus the 
subsequence vr^ • • • 7Tj m _ 2 7rj7rj m _ 1 forms a pattern belonging to T m . (For a better understanding 
draw a picture similar that one in the proof of Theorem |2.1| .) 

On the other hand, it is clear from the diagram construction that the occurrence of a pattern 
of T m in a permutation yields a diagram corner of rank at least m — 2. □ 

In order to study increasing subsequences in permutations which belong to S n {T m ) it would be 
nice to have a surjection S n (T m ) — > <S n (T m _i) similar the map (ft stated in Section 2. Thus the 
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problem could successively put down to the case m = 3. 

By reasoning similar to the proof of Theorem |3.3| , one can show that this theorem holds for each 
m > 3 if k = 3. In case k > 4 and m > 5, the condition i + j > n + 3 — A; + p(i,j) for all diagram 
corners (i, j) is only sufficient for avoiding 213 ■ ■ ■ k and all the patterns of T m . 
For example, the permutation 7r = 5471326 G ^(Ts) avoids 2134 but the square (1,4) is a 
diagram corner of rank 0. 

Confirmed by computer tests, we believe in the Wilf-equivalence of T m U {12 ■ ■ ■ k} and T m U 
{213 ■■■k} for all k > 1 and m > 3. 

Conjecture 5.2 For m > 3, and all n and k we have 

|5 n (T m U{12---A;})| = \S n (T m U{213---k})\. 
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